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Abstract 

In this paper, we develop a simple approach for testing multiple statistical hypotheses based on the 
observations of a number of probability ratios enumerated consecutively with respect to the index of 
hypotheses. Explicit and tight bounds for the probability of making wrong decisions are obtained for 
choosing appropriate parameters for the proposed tests. In the special case of testing two hypotheses, 
our tests reduce to Wald's sequential probability ratio tests. 

1 Introduction 



Consider a continuous-time stochastic process (-Xt)te[o l00 ) denned in a probability space (fi,^",Pr). Sup- 
£>. | pose that the stochastic process (^t)tg[o.oo) is parameterized by 6 G G. In many applications of engineering 

' and sciences, it is desirable to infer the true value of 9 based on the observation of such stochastic pro- 

cesses. This topic can be formulated as a general problem of testing m mutually exclusive and exhaustive 
\ composite hypotheses: 

^:9e6 , JtZ:0eQi, ^ m _i:0e6 m _i, (1) 



where 0i = {9 G 9 : 0, < 6 < 9 i+ i}, i = 0, 1, ■ • ■ , m - 1 with — oo = 9 < 6»i < • ■ ■ < 9 m -i < 9 m = oo. To 
control the probabilities of making wrong decisions, for pre-specified numbers 5i G (0, 1), i = 0, 1, • • • , m— 1, 
it is typically required that 



Oj . Pr{Rcject J% \ 9} < 6 i; V0 G i; i = 0, 1, • • ■ , m - 1 (2) 

where <9, = {9 G 6j : 6»f < 6> < i = 0, 1, • • ■ , m - 1 with 9\, 9" G Q, i = 1, • • ■ , m - 1 satisfying 

-oo = 0£ < ^ < 9i < 9'! < 9' 1+1 < 9 i+1 < 6'! +1 < 9' m = oo for i = 1, • • ■ ,m - 2. The set U^ 1 ^, 9'{) is 
referred to as the indifference zone, since no specification on risk is imposed for the set. Here we consider 
continuous-time processes for the sake of generality, since discrete-time stochastic processes can be treated 
as right-continuous processes in continuous time. 

The hypothesis testing problem defined by ([T]) and ((2]) has been studied extensively for more than 
a half century (see, [H [9] and the references therein). In particular, for the special problem of testing 
two hypotheses, Wald [12] invented the famous Sequential Probability Ratio Tests (SPRTs). Armitagc 
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[I] extended Wald's SPRTs to the general problem of testing multiple hypotheses. Lorden [TU] proposed 
sequential likelihood ratio tests for the same problem. Baum [2] established multiple sequential probability 
ratio tests in a Bayesian framework. At present the general theory of tests on multiple statistical hypotheses 
is much less developed than for the two-decision situation. Existing methods suffer from one or more of the 
following drawbacks: (i) There is no rigorous method for controlling the risk of making wrong decisions; 
(ii) The method of bounding the risk of making wrong decisions is too conservative; (iii) The application 
is limited to simple hypotheses; (iv) The application is limited by the number of hypotheses. Motivated 
by this situation, we develop a new class of tests, referred to as Consecutive Sequential Probability Ratio 
Tests (CSPRTs) based on the principle of probabilistic comparison proposed in [31 El [7]. 

The remainder of this paper is organized as follows. In Section [21 we introduce the connection be- 
tween multi-hypotheses testing and sequential random intervals. In Section [3l we describe the principle 
of probabilistic comparison. In Section [4) we apply the principle of probabilistic comparison to develop 
consecutive sequential probability ratio tests. In Section [SJ wc establish consecutive sequential probability 
ratio tests on parameters of continuous-time processes. Section [6] is the conclusion. All proofs are given in 
Appendices. The main results of this paper have been appeared in our conference paper [7]. 

Throughout this paper, we shall use the following notations. The empty set is denoted by 0. The 
set of positive integers is denoted by N. The notation Pi{E | 9} denotes the probability of the event E 
associated with parameter 9. The expectation of a random variable is denoted by E[.]. The support of 
a random variable Z is denoted by Iz- In the discrete-time case, the stochastic process (A t ) tg [ 0oo ) is 
actually a sequence of random variables X\, X2, ■ ■ ■ ■ For simplicity of notations, let X n = {X\, • • • , X n ) 
for n £ N. Let x n = (xi,--- , x n ) denote the realization of X n . Let /„(x„;#) denote the probability 
density function (PDF) or probability mass function (PMF) of (Xi,--- ,X n ) parameterized by 8 £ 6. 
Accordingly, replacing x„ in / n (x ra ;#) by X n gives the likelihood function f n (X n \9). For 0',0" £ and 
K > 0, we use T n (X n ; 9', 9") ~ k to represent f n (X n ; 9") ~ Kf n (X n ; 9'), where "~" is a relation such 
as "<, =, >, <, >", corresponding to "less than, equal, greater than, less or equal, greater or equal", 
respectively. The notation T n (X n ; 9', 9") can be interpreted as the likelihood ratio j^n^rm whenever 
f n (X n ; 9') is not equal to 0. We shall frequently use the concept of unimodal function. A function is said 
to be unimodal with respect to 9 £ 9 if there exists a number 9* such that the function is non-decreasing 
with respect to 9 £ O no greater than 9* and is non-increasing with respect to 8 £ no less than 8* . The 
other notations and concepts will be made clear as we proceed. 

2 Multi-hypotheses Testing and Sequential Random Intervals 

As demonstrated in [3] , the general hypothesis testing problem defined by (TIJ and can be cast into the 
framework of constructing a sequential random interval with pre-specified coverage probabilities. This can 
be illustrated in the sequel. 

To reach a fast decision, it is desirable to solve the hypothesis testing problem by a multistage approach 
such that the sampling procedure is divided into s stages with observational times tg, I = 1, • • • , s, where 
tt is the observational time at the £-th stage. Starting from I = 1, at the £-th stage, based on the 
observation of (X t )o<t<t e , pre-determined stopping and decision rules are applied to check whether the 
accumulated observational data is sufficient to accept a hypothesis and terminate the sampling procedure. 
If the observational data is considered to be insufficient for making a decision, then proceed to the next 
stage of observation. The observation is continued stage by stage until a hypothesis is accepted at some 
stage. Although the number of stages s may be infinity, for practical considerations, the stopping and 
decision rules are required to guarantee that the sampling procedure will surely eventually terminate with 
a finite number of stages. Central to a multistage procedure are the stopping and decision rules, which 
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can be related to a sequential random interval described as follows. Let 9' Q = — oo and Q" n — oo. For 
i = 0, 1, • • • , m — 1, let Si denote the open interval (<?£, Let Z be the index of stage at the termination 

of the sampling procedure. Let C and U be random variables defined in terms of samples of the stochastic 
process up to the Z-th stage such that the sequential random interval (C,tl) has m possible outcomes 
Si, i = 0, 1, • • • ,m-l and that Pr{£ < 6 < U \ 9} > I - 6 t for any g % and i = 0, 1, • • • , m — 1. Given 
that the sequential random interval {C,M) satisfying such requirements is constructed, the risk requirement 
l[2|) can be satisfied by using {C,U) to define a decision rule such that, for i = 0, 1, • • • , m — 1, hypothesis 
is accepted when the sequential random interval (C, IX) takes Si as its outcome at the termination of 
the sampling process. It follows that {Accept J^} = {C < < U} for any G 0, and z = 0, 1, • ■ ■ , m — 1. 
Therefore, to solve the multi- valued decision problem defined by ([T]) and ((2]), the objective is to ensure 
that is included in the sequential random interval with pre-specified probabilities. In the sequel, we shall 
propose a general approach for defining stopping and decision rules for the construction of such sequential 
random interval. 

3 Principle of Probabilistic Comparison 

In [3j [7] , a general methodology has been proposed for constructing sequential random intervals with 
prescribed specifications of coverage probabilities. The main idea is to use one-sided confidence sequences 
to control the coverage probability of the sequential random interval. Assume that the number of stages, s, 
and the observational times, tg, I = 1, ■ ■ • , s, arc given. Assume that for t = 1, • ■ ■ , s and i = 1, ■ ■ ■ , m — 1, 
random variables Lg.i and Ui.i can be defined in terms of positive numbers £, ctj, Pi and the set of 
random variables (X t )o<t<t e such that Pr{L^ > | 0} and Prjt/^i < | 0} can be made arbitrarily 
small by decreasing C,oti and £A respectively. Due to such assumption, we call (—oo, Z^i] and [£/£,.;, oo) 
one-sided confidence intervals for 0. Accordingly, (— oo, Lgj], t = 1, • ■ ■ , s and [C/f,i, oo), £ = 1, • • ■ , s are 
said to be one-sided confidence sequences for 0. In view of the controllability of the coverage probabilities 
of the one-sided confidence intervals, the number £ is referred to as the coverage tuning parameter, and 
oti, Pi, i = 1, • • ■ , m — 1 arc called weighting coefficients. Given that £ is sufficiently small, > 0[ will be 
credible if Z^ ; ; > 0^ is observed. Similarly, < 0f will be credible if Ug t i < 6" is observed. To figure out 
the general structure of stopping and decision rules, imagine that the sampling procedure is stopped at the 
£-th stage and Ji is to be designated as the outcome of the sequential random interval. Since J^i contains 
[O'l, 0- +1 ], it follows that for g [0'{ , 9' i+1 ], it is true that < ff! for j > i and > 0^ for j < i. This implies 
that, if the coverage tuning parameter ( is sufficiently small, then it is very likely to observe that Uij < 0" 
for j > i and Lgj > O'j for j < i. Therefore, turning this thinking around leads to the following stopping 
and decision rules: 

Continue observing the stochastic processes until for some i € {0, 1, • • • , m — 1}, the event 
{Utj < 0" for j > i and Le,j > 0j for j < i} occurs at some stage with index I € {1, ■ ■ • , ,s}. 
At the termination of the sampling process, make the following decision: If such index i is unique, 
then designate Si as the outcome of the sequential random interval. If there are multiple indexes 
satisfying the condition, then pick one of them and assign the corresponding interval Si as the 
outcome of the sequential random interval based on a predetermined policy. 
The idea in the derivation of the above stopping and decision rules is to infer the location of relative 
to the sequential random interval by comparing the confidence limits with the endpoints of the sequential 
random interval. Due to the probabilistic nature of the comparison, such method of constructing stopping 
and decision rules is referred to as the Principle of Probabilistic Comparison. It should be noted that 
similar principles have been proposed in [4j [6] for multistage estimation of parameters. The properties of 
the above stopping and decision rules are indicated by the following probabilistic result. 
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Theorem 1 Let a® = &o = — oo, a m = b m = oo and a, < o, < a,-_|_i < /or i = 1, • • ■ , to — 2. Let 
6> = (-oo, ai], 6> m _i = [o m _i,oo) and Oi = [6 !; ,a ? ; + i] for i = 1,- ■ ■ ,m — 2. Let (fi, ^, {^}, Pr) oe a 
filtered space. Let t be a proper stopping time with a support I T . For £ £ I T , let Lg^ m = — oo, L^,o = oo and 
let Le,i, Ue,i, i = 1, - ■ ■ ,m — 1 be random variables measurable in Let C and 1A be random variables 
such that U™q 1 {Z^ = a*, U = 0i+i} = fl and that {r = £, C = a^, W = ftj+i} C {L^; > a t , < i < 
j and Ue^i < b iy j < i < m} /or £ £ I T and j = 0, 1, ■ ■ • , to — 1. Then, Pr{£ > 0} = Pr{£ > a.; + i} < 
Pr{i^ i?+ i > a l+ i /or some £ £ I T } and Pr{U < 9} = Pr{U < &,} < Pr{Ue.i < 6,: for some £ £ L T } for 
i = 0, 1, • • • ,to — 1 and 9 £ Oi. 

See Appendix [S] for a proof. 



4 Consecutive Sequential Probability Ratio Tests 

In this section, we shall apply the principle of probabilistic comparison and Theorem [T] to develop a new 
class of tests for solving the multi- valued decision problem defined by (flj and @ regarding the parameter 
9 £ associated with a discrete process {X n ) n£ j^, where Af is a subset of positive integers. For generality, 
we do not restrict Af as an unbounded set such as N. Our purpose is to accommodate the situation that the 
sequence of X n can be of finite length. A familiar example can be found in the context of sampling without 
replacement from a finite population of N units, among which Np units having a certain attribute. If we 
define a Bernoulli random variable X n such that X n assumes values 1 or in accordance with whether 
the n-th drawn unit has the attribute, then we have a sequence of dependent Bernoulli random variables 
{X n ) n £N' with Af = {1, 2, • • • , N}. Throughout the remainder of this paper, we use symbol N* to denote 
oo if Af is unbounded and otherwise the maximum of Af. 



4.1 Confidence Sequences 

For the purpose of deriving sequential tests based on the principle of probabilistic comparison, we need a 
method for constructing confidence sequences as described by the following theorem. 

Theorem 2 For n £ Af, let X n be random variables parameterized by 9 £ O and let the likelihood function 
be denoted by f n (X n ;9). Let 5 £ (0,1) and let 9q, 9\ £ O with 9q < 8±. Define random variables 
L n {X n ) = inf{tf £ 9 : T n {X n -9 1 ,d) > §} and U n (X n ) = sup{^ £ 6 : T n (X n ; 6 , 0) > §}. The following 
statements hold true. 



(I) For all 9 £&, 



Pr{L n (X n ) < 9 for alln £ Af | 9} > 1 - -, 

Pr{U n (X n ) > 6 for alln £ Af \ 6} >1 - -, 
Pr{L n {X n ) < 9 < U n (X n ) for all n £ Af \ 9} > 1 - 5. 



(II) For all n £ Af, 



{L n (X n ) > 9q} C < T n (X n ;9i,9o 

)<^Y {U n (X n )<9 1 }£ jr rl (A-„;0 o A) < \ 
(III) If f„ (X n ;9) is unimodal with respect to 8 £ O, then 

{L n (X n ) > 9 } 2 |t„(^„; 9i, 6*o ) < i\ , {U n (X n ) < 9,} D (r n (* n ;0 o ,0i) < | 



2 



for all n £ Af. 
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See Appendix [B] for a proof. 

Assuming that f n (X n ;6) is unimodal with respect to 9 £ and that 6 is a discrete set or / n (AT n ;0) 
is continuous with respect to 8 £ 0, we have 

{£„(#„) > #o} = |t„(A-„; 1; o ) < £ J , {£/„(#„) < 0J = |T n (AT n ; O , #i) < | 

for all n£ Af. 

4.2 CSPRTs on Multiple Composite Hypotheses 

In order to construct a sequential test, choose aj, ft S (0, 1) for i = 1, • • • , m — 1 and a m = ft) = 0. Define 
lower confidence limit 

L n>i = inf{tf 6 6 : T n {X n ;%,#) > aj 

and upper confidence limit 

U n ,t = sup{i? £ 6 : T n (AT n ;flJ,i?) > ft} 

for i = 1, - • • , m — 1. Making use of the principle of probabilistic comparison, we propose stopping and 
decision rules as follows: 

Continue the sampling process until there exists an index j £ {0, 1, ■ • • , m — 1} such that 

L nj i > 9 i , < j < j and C/ rlj i < 0" , j < i < m. 

At the termination of the sampling process, accept M'j with the index j satisfying the stopping condition. 

As a consequence of Theorems [1] and [2J we have that if the sampling process will eventually terminate 
with probability 1, then Pr{Rcject | 8} < ctj+i + ft for < i < m and 8 € &i. 

Under the assumption that f n {X n \9) is unimodal with respect to 8 £ O and that O is a discrete 
set or f n (X n \9) is continuous with respect to 8 £ 0, it follows from Theorem [2] that > 6>-} = 

{T n (Af n ;^',^) < a;} and < = {T n (A?„; ^, < ft} for < i < m. Hence, the stopping and 

decision rules can be simplified as follows: 

Continue the sampling process until there exists an index j in the set {0, 1, • • • , m— 1} such that 
T„(AT„; 6'i, Q'l ) > i for0<i<j and T n (Af n ; 0<, 6»f) < ft /or j < i < m. i/ie termination of 
the sampling process, accept Jffj with the index j satisfying the stopping condition. 
A salient feature of our test is that m — 1 consecutive probability ratios are used for defining the stopping 
and decision rules. The name Consecutive Sequential Probability Ratio Test is derived from such nature 
of the test. We have established that the consecutive sequential probability ratio test has the following 
properties. 

Theorem 3 Assume that the likelihood function f n (X n \8) is unimodal with respect to 8 £ O for any 
n £ J\f. If the sampling process will eventually terminate according to the stopping rule with probability 1, 
then the following statements (I)-(III) hold true: 

(I) Pv{Reject J% \ 6} < a t+1 + ft for < i < m - 1 and 8 £ O t . 

(II) For j — 1, • • ■ , m — 1, Pr{Accept with some index i no less than j | 8} is no greater than oij 
and is non- decreasing with respect to 8 £ no greater than 8'y 

(III) For j = 1, • • • , m — 1, Pr{Accept M\ with some index i less than j | 8} is no greater than ft and 
is non-increasing with respect to 8 £ no less than 8" . 

Moreover, the sampling process will eventually terminate according to the stopping rule with probability 
1, provided that the following additional assumption is satisfied: For arbitrary ot, /3 £ (0, 1) and 8 £ 0, 

Pr(/3<T n (Af„;0^')<-|4^ O > i = l,---,m-l (3) 
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as the sample number n tends to N* . 

See Appendix [C] for a proof. It should be emphasized that throughout this paper, the notion of "the 
sampling process will eventually terminate according to the stopping rule" is that the stopping rule is 
satisfied for some n € TV. 

Statement (I) of Theorem [3] provides a simple method for controlling the risk of making wrong decisions. 
To satisfy the risk requirement ([2]), it suffices to choose cti and Pi such that oti+\ +/3j < Si for < i < m— 1. 
Specially, one can simply use a± = Sq, P m ~i = <5?«-i and = Pi = 4f for 1 < i < m — 2 in the stopping 
and decision rules for purpose of ensuring ([2]). 

4.3 CSPRTs on Multiple Simple Hypotheses 

In some situations, it may be interesting to test multiple simple hypotheses 

,J%:0 = 6 Q , je 1 :0 = 1 , Jf m -i : 9 = 9 m . x . (4) 

For risk control purpose, it is typically required that, for prescribed numbers Si G (0, 1), 

Pr {Reject J% | 0J < Si, i = 0, 1, • • • , m - 1. (5) 
As before, let cti, /?,; E (0, 1) for i = 1, • • • , m — 1 and a m = /So = 0. Define lower confidence limit 

L n ,i =inf{tf G 6 : T B (Ar n ;0 <+ i,0) > aj 

and upper confidence limit 

[/■„,< = sup{^ G 6 : TniXn-A,^) > A} 

for i = 1, ■ ■ ■ ,m — 1. By the principle of probabilistic comparison, we propose the following stopping and 
decision rules: 

Continue the sampling process until there exists an index j G {0, 1, ■ ■ • , m — 1} such that 

L n ,i>d l , 0<i<j and U na <6 i+ i, j < i < m - 2. 

At the termination of the sampling process, accept M'j with the index j satisfying the stopping condition. 

Under the assumption that f n (X n ; 9) is unimodal with respect to 9 € 0, it follows from Thcorcm[5]that 
{L n ,i > 9i] = {T n {X n ;9 i+1 ,6i) < aj and {U n , t < 9 l+1 } = {T n (X n ; 8 U 9 i+1 ) < A} for < i < m - 2. 
Hence, the stopping and decision rules can be simplified as follows: 

Continue the sampling process until there exists an index j in the set {0, 1, • • • , m — 1} such that 
T„(A' I j; 9i-i, 9i) > — for < i < j and T n (X n ; 0j_i, 9i) < f3i for j < i < m. At the termination 
of the sampling process, accept fflj with the index j satisfying the stopping condition. 
We have shown that the above consecutive sequential probability ratio test has the following properties. 

Theorem 4 // the sampling process will eventually terminate according to the stopping rule with probability 
1, then Pv{Reject \ 9i\ < oii+i + Pi for < i < m — 1. Moreover, the sampling process will eventually 
terminate according to the stopping rule with probability 1, provided that the likelihood function f n (X n ;9) 
is unimodal with respect to 9 G for any positive integer n, and that for arbitrary a, /3 G (0, 1) and 9 G 0, 

Pr j/3 < T n (X n ;ei-i,9i) < i | j -> 1, i = l--- ,m-l 

as the sample number n tends to N* . 
See Appendix [D] for a proof. 

According to Theorem [4] to guarantee the risk requirement (|2|), it suffices to choose ai and j3i such that 
oii+i + Pi < Si for < i < m — 1. Particularly, one can use ct\ = So, ftm-\ = S m -\ and a^+i = pi = 4f for 
1 < i < m— 2 in the stopping and decision rules to ensure that Pr {Reject J#i \ 9i} < Si, i = 0, 1, • • • , m— 1. 
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4.4 General Termination Properties 

In Theorems [3] and HI one of the assumptions that we use to establish the termination properties is that 
the likelihood functions are unimodal on 0. Actually, with regard to the CSPRTs on composite and simple 
hypotheses proposed in Sections 14.21 and 14.31 the termination properties are valid under fairy general 
assumptions, as asserted by the following results. 

Theorem 5 The sampling process will eventually terminate according to the stopping rule with probability 
I, provided that the following assumptions are satisfied: 

(I) For arbitrary a, (3 G (0, 1) and 9, 9', 9" G 6 with 9' < 9", 

Pr{/3<T n (* n ;0',0")< i |flj^0 (6) 

as the sample number n tends to N* . 

(II) For arbitrary a G (0, 1) and 9, 9', 9" G 8 with 9' < 9" < 9, 

Pr^r n (X n ;9',9") > I | j -> 1 

as the sample number n tends to N* . 

(III) For arbitrary (3 G (0, 1) and 9, 9', 9" G 9 with 9 < 9' < 6", 

Pr{T n (AT n ;0',0")</3|0}->l 

as the sample number n tends to N* . 

Theorem [5] can be established by mimicking the argument of the termination property of Theorem [3] 
as in Appendix [Cl 

It should be noted that (JU) implies 



Prj^ < TJX n ;9',e") < - for all n G N \ 9 
y a 



0, (7) 



which has been established in |12l Appendix A.l], under a very general assumption, for the termination 
property of Wald's sequential probability ratio tests on two hypotheses. However, ([7]) does not imply ©. 

Actually, in the case that X±, X2, ■ ■ ■ are i.i.d samples of X parameterized by 9 G 0, the assumption 
(I) of Theorem [S] holds under fairy general conditions, as can be seen by the following result. 

Theorem 6 Let 9,9' ',9" G 6. Assume that Pr{/(A; 9')f(X; 9") = | 9} = and that the variance of 



In 



/(X- W) * s P os tti ve and finite. Then, for arbitrary a, j3 G (0, 1), 



lim Pr I (3 < T n (X n ;9', 9") <-\6\=Q. 



a 



See Appendix H for a proof. It should be noted that if Pr{/(A; 9')f(X; 9") = | 9} > 0, then 
lim^oo Pr {(3 < T n (X n ; 9', 9") < ± | 6} = 0. 

In the case that X\,X2, ■ ■ ■ are i.i.d samples of X parameterized by 9 G 0, the assumptions (II) and 
(III) of Theorem [5] are valid under fairy general conditions, as can be seen by the following result. 

Theorem 7 Let 9, 9', 9" G 6 and a, (3 G (0,1). Assume that Pr{f(X; 9')f(X; 9") = | 9} = and that 
the variances o/ln/(A;#') and ln/(A;#") associated with 9 are positive and finite. Then, 

(I) lim„_ i . 00 Pr \T n (X n ; 9', 9") > — | 0} = 1 holds under the additional assumption that E[ln/(A;#') | 
9}<E[\nf(X;9")\9}. 

(II) limn^oo Pr {T n (X n ; 9', 9") < (3 \ 9} = 1 holds under the additional assumption thatW J [lnf(X;9') \ 
9}>E[\nf(X;9")\9}. 
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See Appendix [F] for a proof. 

It should be noted that if Pr{f(X; 0') = | 6} > 0, then lim^oo Pr{T„(Af n ; 6', 6") > ± | 6} = 1. 
Similarly, if Pr{/(A; 9") = | 9} > 0, then lim^^ Pr {T n (X n ; 6', 9") < P\9} = 1. 



4.5 One-sided Hypotheses 

It should be noted that in the special context of testing two hypotheses, our CSPRTs reduce to Wald's 
SPRTs. 

For the problem of testing simple hypotheses J%o : 9 = 9q versus 3%\ : 9 = 6\, the likelihood function 
f n (X n ;9) is unimodal with respect to 6 £ 9, since there are only two values in the parameter space 0. 
Therefore, the required assumption of our CSPRT is the same as that of Wald's SPRT. 

For the problem of testing composite hypotheses Jtf?o : 9 < 9$ versus M\ : 9 > 6\, our CSPRT requires 
the assumption that the test will surely eventually terminate and that the likelihood function f n (X n ;9) 
is unimodal with respect to 9 £ 0. It has been previously known that the SPRT is applicable to the 
composite hypotheses under the assumption that the SPRT will surely eventually terminate and that the 
relevant likelihood ratio is monotone. 

We would like to point out that there arc some situations where the relevant likelihood ratio does not 
possess the monotonicity property, but the likelihood function f n (X n ; 9) is unimodal with respect to 9 £ 0. 
To illustrate, consider hypotheses regarding the distribution of random variable X uniformly distributed 
on [9 — a, 9 + a] with known a > and unknown parameter 9. Suppose one wish to test hypotheses on 
9 based on i.i.d. samples X\, X 2l ■ ■ ■ of X. Since for any sample number n, the likelihood ratio needs 
to be expressed in terms of min{Xi, • • • , X n } and max{Xi, • • • , X n }, we can conclude that the likelihood 
ratio does not possess the monotonicity property. However, it can be readily shown that the likelihood 
function f n (X n ; 9) is unimodal with respect to £ 0. From this discussion, it can be seen that our result 
in Theorem [3] has extended the applications of Wald's SPRTs to a wider variety of composite hypotheses. 



4.6 Two-sided Hypotheses 

Consider a classical problem of testing two-sided hypotheses Hq : 9 = -Oq versus Hi : 9 7^ $0, with ^0 £ ©■ 
As pointed out by Wald [HI Section 4.4.4, page 77], it is a common contention that the acceptance of Hq 
will not be considered a serious error if 9 ^ $0 but is near t?o- However, there will be, in general, two 
parameter values a and b with a < i?o < b such that the acceptance of Hq is considered an error of practical 
importance if (and only if) 9 ^ (a, b). Thus, the region of preference for rejection may be defined as the set 
of all values 9 for which 9 ^ (a, b). The region of preference for acceptance will consist of the single value 
t?o, an d the region of indifference will be the set of all values 9 for which (a,i?o) U (da^b). To control the 
risk of making wrong decision, it is typically required that 

Pr{Rcject H \ 9} < a for 6 = tf (9) 

and 

Pr{ Accept H I 9} < $ for 9 £ such that 9 f (a, b). (10) 

To solve this problem, Wald proposed the principle of weight function. However, an appropriate weight 
function is difficult to find, especially for discrete distributions. We propose to solve the problem by 
constructing CSPRT for the following three new hypotheses 



S 



so that 

Pr{Reject 3tf \ 9} < ~ for 9 < a; Pr{Reject | 0} < a for 6 = tf ; Pr{Reject | 9} < | for (9 > b. 
This can be accomplished by applying the CSPRT with m = 3, Jo = % i = a > $2 = § and 



'i = — o — > p 2 = 



2 ' 2 ' 



91 = 0, 0?=0 O , ^ 2 =^o, ^' = 6, 



/3 a a /3 

«i = 2 > a 2 = 2 ' "3 = 0, Po = 0, Pi = — , @ 2= 2' 

At the termination of the CSPRT, the decision on the original hypotheses Hq versus H\ is made based 
on the decision on the new hypotheses Jtf^, M{ and 3%2 by the following rule: 
Accept H if M{ is accepted; Reject H if either J#o or M% is accepted. 

Based on this proposal, it can be readily shown that the risk requirements ^ and (fTUf are satisfied. 



4.7 CSPRTs on Parameters of Exponential Family 

In this section, we shall show that the CSPRTs can be applied to the parameters of the exponential family 
under mild assumptions. Let A be a random variable with PDF or PMF of the form 

fx(x;6) = h(x)exp[u(0)T(x) - v(6)}, 

where T(x) and h(x) are functions of x, and u(9), v(9) are functions of 9 G 0. We have obtained the 
following results. 

Theorem 8 Assume that dv }P = 9 du ^ and that dw jp > for 9 G 8. Let X\, A2, • •• be i.i.d. samples of 
X. Then, for any n G N, the likelihood function f n (X n ;9) is unimodal with respect 9 G 0. Moreover, for 
arbitrary a,0 G (0, 1) and 9, 9', 9" G 6 with 9' < 9", 

lim Pr (p < T n (X n ;9\ 9") <-\o\=Q. 

n-»oo a J 

See Appendix [G] for a proof. It can be readily verified that the assumption of Theorem [5] is satisfied 
for the binomial, Poisson, normal, exponential, gamma, geometric and negative binomial distributions. 



4.8 CSPRTs on Proportion of Finite Population 

Consider a finite population of N units among which there are Np units having a certain attribute, where 
p£0 = {4j : i = 0,1, - ■ ■ , N}. Many practical problems can be formulated as the multiple hypotheses 
testing problem defined by ([I} and ([2]), with the parameter 9 identified as p. For such a problem, consider 
sampling without replacement. As before, define a Bernoulli random variable X n such that X n assumes 
values I or in accordance with whether the n-th drawn unit has the attribute. This leads to a sequence of 
dependent Bernoulli random variables Ai, ■ ■ • , Ajy parameterized by p G 0. The following analysis shows 
that our CSPRTs can be applied to the general multiple hypotheses testing problem. 
Clearly, the likelihood function is 



f n {X n ;p) 



(Np\ (N—Np\ 



where K n = £" =1 A,. Let a, p G (0, 1) and p,p> \p" G 9 with p' < p" . 



In the case of p < p', we have Jn(X n,p") — 0. Thus, Jn(X n',p") > PfN(X n',p') is violated. 
In the case of p > p" , we have Jn{X n\p') = 0. Thus, fN^N'tP') > afN(X n',p") is violated. 
In the case of p' < p < p" , it must be true that Jn{Xn\p') = In{X n',p") = 0, which implies that both 
f N (X N ;p") > /3f N (X N ;p') and f N (X N ;p') > af N (X N ;p") are violated. 
This proves that 

Pr j/3<T„(* n ;pV) < i | p| -> 
as n — > AT. It can be shown by direct computation that f n (X n ;p) is unimodal with respect to p. 



4.9 Unimodal Property of Various Distributions 

In addition to the exponential family and the distribution associated with a sampling without replacement 
from a finite population, the likelihood functions of a wide variety of distributions have the desired unimodal 
properties which permit the applications of CSPRTs. A few of such distributions arc outlined in the sequel. 



4.9.1 Positive Power Law Distribution 

A random variable X is said to have a positive power law distribution if the density function of X is given 
by 

, , \ j^rrX K forx G [0, 7 ], 

[0 for x [0,7], 

where K > and 7 > 0. Clearly, taking k = gives the uniform distribution. It can be checked that for a 
given 7 > 0, the likelihood function f n (X n ; 7, k) is unimodal with respect to k. On the other hand, when 
k > is fixed, f n (X n ; 7, k) is unimodal with respect to 7 > 0. 



4.9.2 Pareto Distribution 

The Pareto distribution is given in density-function form by 




for x € [7, 00), 
for x ^ [7, 00), 



where k > and 7 > 0. It can be shown that for any given 7 > 0, f n (X n ;"f, n) is unimodal with respect 
to k. When k is fixed, f n (X n ; 7, k) is unimodal with respect to 7 > 0. 



4.9.3 Normal Distribution with Known Mean 

The normal distribution is given in density-function form by 

/x(w) = ___ exp (-^^), 

where —00 < fi < 00 and a > 0. It can be shown that for any given (i, the likelihood function f n (X n ; [i, a) 
is unimodal with respect to a. 
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4.9.4 Laplace Distribution 

A random variable X is said to have a Laplace distribution if the density function of X is given by 

fx(x;fi,v) = — exp 

2v \ v 

where — oo < fi < oo and v > 0. It can be shown that for any given (i, the likelihood function f n (X n ; fj,, v) 
is unimodal with respect to v. 

4.9.5 Negative Exponential Distribution 

The negative exponential distribution is given in density-function form by 



fx{x;fi,v) 



'icxp(-^i) for x £ \p,, oo), 
for x ^ [/!, oo), 



where — oo < (i < oo and v > 0. Clearly, for any given fi, the likelihood function f n (X n ; [i, v) is unimodal 
with respect to v > 0. On the other hand, when v > is fixed, f n {X n ; /i, f) is unimodal with respect to (i. 

4.9.6 Weibull Distribution 

The Weibull distribution is given in density-function form by 

Kj /x\ k ~^ / fx\ K \ 
f x (x;\,K) = - (jj cxp V _ Ia//' X>0 ' K>0 ' A> ° 



It can be shown that for any given k > 0, the likelihood function f n (X n ; A, k) is unimodal with respect to 
A > 0. 

5 Continuous-Time Stochastic Processes 

By a similar approach as that of the CSPRTs for the discrete-time process {X n ) n ^, we can develop 
CSPRTs for a continuous-time processes (^t)te[o,oo) parameterized by 9 £ 8. Throughout Sections 15.11 
and 15.21 let (^t)tg[o,oo) be a right-continuous stochastic process parameterized by 9 £ and let the 
probability mass or density function of X t be denoted by ft(-',9) for i £ [0, oo). Assume that ft(x;9) is 
right-continuous with respect to t £ [0, oo) for any 9 £ O and x £ R. 

5.1 Maximal Inequality and Confidence Sequences 

For parameter values 9', 9" £ O, define likelihood ratio T t (X t ; 9' 7 9") = f^t-S') ^ ^ [0,oo). We have 
established the following results on maximal inequalities and confidence sequences. 

Theorem 9 Assume that for arbitrary integer n and real numbers t i7 i = 0, • • • ,n with = t < t\ < 
■ ■ ■ < t n -\ <t n ~t, the conditional probability mass or density function of X ti , i = 0, 1, • • ■ , n — 1 given 
the value of X t does not depend on 9. Let 9q, 9\ £ O and S £ (0, 1). Then, 

Pr jT t (X t ;0 O! 0i) > ^ for some te [0, oo) | 6 \ < S. (11) 

Moreover, Pr{L t (X t ) < 9 for all t \ 9} > 1 - §, Pr{U t (X t ) > 9 for all t \ 9} > 1 - | and Pr{L t (X t ) < 
< U t (X t ) for all t \ 9} > I — S for all 9 £ 6, where L t {X t ) = M{d £ 9 : T t {X t ;6 1 ,'&) > f} and 
U t (X t ) = sup{i? £ 6 : T t (X t ; 9 , <?) > |}. 
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See Appendix IH1 for a proof. If the likelihood function ft(X t ; 9) is unimodal with respect to 9 £ G, then 
there exists an estimator 9t for 9 such that ft (X t ; 9) is non-decreasing with respect to 9 £ G no greater 
than 9 t and is non-increasing with respect to 9 £ G no less than 9 t . Hence, it must be true that {9 t < 9q} ^= 
{r t (Xt;6i,0 ) > 1} and consequently, {r t (X t ;6 1 ,9 ) < f, % < 9 Q } C {T t (X t ; U 6 ) < 1, 9 t < 9 } = 0. 
It follows that 

r t (Xf,9i,e ) < II = (r^X^A) < 1 At < Oo 



2J ^-„ v --.,-,,- w 2 , 

C ( [ T t (X t ;9 1 ,9)<^foy a \\0<0^ (12) 
C {L t (X t )>^o}, 

where (|T2l is also a consequence of the assumption that the likelihood function ft(X t ; 9) is unimodal with 
respect to 9 £ G. 



5.2 CSPRTs on Multiple Hypotheses 

For the multi-hypotheses testing problem defined by ([1) and ([2]), we propose a CSPRT with stopping and 
decision rules as follows: 

Continue observing (^t)te[o.oo) until there exists an index j in the set {0, 1, ■ ■ • ,m — 1} smc/j i/iai 
T t pf t ;6K,6>f) > ^- forO <i<j and T t (.X t ; 0") < ft for j < i < m. At the termination 
of the observational procedure, accept Jifj with the index j satisfying the stopping condition. 
We have established that the above CSPRT has the following properties. 

Theorem 10 Assume that for arbitrary integer n and real numbers ti, i = 0, ■ •■ ,n with = to < t\ < 
■ ■ • < t n -\ < t n = t, the conditional probability mass or density function of X ti , i = 0, 1, • • ■ , n — 1 given 
the value of X t does not depend on 9. Assume that the likelihood function ft(X t ; 9) is unimodal with respect 
to 9 £ & for any positive number t. If the observational process will eventually terminate according to the 
stopping rule with probability 1, then the following statements (I)-(III) hold true: 

(I) Pr{Reject J% | 9} < a t+1 + ft for < i < m - 1 and 9 £ t . 

(II) For j = 1, • • • , m — 1, Pr{Accept J4?l with some index i no less than j \ 9} is no greater than ctj 
and is non- decreasing with respect to 9 £ G no greater than 9'j . 

(III) For j = 1, • • • , m — I, Pr{Accept with some index i less than j \ 9} is no greater than /3j and 
is non-increasing with respect to 9 £ G no less than 9" . 

Moreover, the sampling process will eventually terminate according to the stopping rule with probability 
1, provided that the following additional assumption is satisfied: For arbitrary a, (3 £ (0, 1) and 9 £ G, 

lim Pr (/3 < T t (X t ;0j,0O <-\e\=0, i = l,-,m-l 
t-s-oo a j 

The proof of Theorem [TU] is similar to that of Theorem [3J 

For testing simple hypothesis defined by (U]) and ([5]), we propose a CSPRT with stopping and decision 
rules as follows: 

Continue observing (^t)tg[o.oo) until there exists an index j in the set {0, 1, • • ■ ,m — 1} such that 
Y t (X t ;9i-i,9i) > — for < i < j and T t (X t ;9i-i,9i) < ft for j < i < m. At the termination 
of the observational procedure, accept Jifj with the index j satisfying the stopping condition. 
We have established that such CSPRT possesses the following properties. 
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Theorem 11 Assume that for arbitrary integer n and real numbers ti, i = 0, ■ •■ ,n with = to < t\ < 
• • • < t n -\ < t n = t, the conditional probability mass or density function of X ti , i = 0, 1, • • • , n — 1 given 
the value of X t does not depend on 9. If the observational process will eventually terminate according to 
the stopping rule with probability I, then Pr{ iieject Ji?i \ 9i} < + ft for < i < m— 1. Moreover, the 
observational process will eventually terminate according to the stopping rule with probability 1, provided 
that the likelihood function ft(X t ; 9i) is unimodal with respect to 9 € O, and that for arbitrary a, /3 E (0, 1) 
and 9 £ 0, 

limPr(/3< T t (X t ; < i | j = 0, * = 1, • • • ,m- 1. 

The proof of Theorem [TT] is similar to that of Theorem SJ 



5.3 CSPRTS on Arrival Rates of Poisson Processes 

Consider a Poisson process (-Xt)te[o,oo) with an arrival rate A > 0. Note that for 7 > 0, 

ft(X t ;X 1 ) > 1 f > (A 1 -A )t + ln 7 l 



/ t (X t ;A ) 'J In A 



For testing multiple composite hypotheses defined by (JT]) and with 0, 0-, 0,, 0" identified as A, A,-, A,, A-' 
respectively, we propose a CSPRT with stopping and decision rules as follows: 



Continue observing (-Xt)te[o,oo) until there exists an index j in the set {0, 1, • • ■ , m — 1} sweft t/iai 
X t > — ^77- — — for < i < j and X t < — — Ai ^ ln ^' for j < i < m. At the termination of 



the observational procedure, accept M'j with the index j satisfying the stopping condition. 



Regarding the above CSPRT, we have shown the following result. 

Theorem 12 The observational process will eventually terminate according to the stopping rule with prob- 
ability 1. Moreover, the following statements (I)-(III) hold true: 

(I) Yr{Reject J% \ X} < a l+1 + ft for < i < m - 1 and A e 6>, . 

(II) For j = 1, ■ ■ • Yr{Accept M'i with some index i no less than j \ A} is no greater than otj 
and is non- decreasing with respect to A G Q no greater than \j . 

(III) For j = 1, • • • ,771—1, Pr{Accept J%i with some index i less than j \ A} is no greater than ft and 
is non-increasing with respect to A S O no less than A". 

See Appendix U for a proof. 

For testing multiple simple hypotheses defined by (j4]) and (0, with 9, 9i identified as A, Ai respectively, 
we propose a CSPRT with stopping and decision rules as follows: 



Continue observing (-Xt)te [0,00) until there exists an index j in the set {0, 1, ■ • • , m — 1} such that 
X t > — — — — for < i < j and X t < ^ A '" A '~ 1 2* +ln ^' for j < i < m. At the termination 

In -r — - — In -r — 1 — 

A i-1 A t-1 

of the observational procedure, accept Jtf'j with the index j satisfying the stopping condition. 



Regarding the above CSPRT, we have shown the following result. 

Theorem 13 The observational process will eventually terminate according to the stopping rule with prob- 
ability 1. Moreover, Pr { Reject Jtfi \ \i} < on+i + ft for < i < m— 1. 

Theorem [13] is a direct consequence of Theorem [TTJ 
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5.4 CSPRTS on Parameters of Brownian Motions 

Consider a Brownian motion (-?Q)te ro,oo) with unknown drift \i and known variance a 2 per unit time. Note 
that for 7 > 0, 

f t (X t ;ni,a) \ ( (/i +Mi)t cr 2 

> 7 S = <^ X 4 > 1 In 7 



f t (X t ;no,cr) ) { 2 Mi -Mo 

For testing multiple composite hypotheses defined by (JXJ) and © with 0, 0^, 0" identified as m, Mi? Mi; m" 
respectively, we propose a CSPRT with stopping and decision rules as follows: 



Continue observing (^t)te[o,oo) until there exists an index j in the set {0, 1, • • ■ ,m — 1} smc/i 
that X t > { ^ + f ]t + In ^ /or < i < j and JT t < M±Ol + _<lL_ i n / or j < i <m . 

At the termination of the observational procedure, accept Jifj with the index j satisfying the 
stopping condition. 



With regard to above CSPRT, we have shown the following results. 

Theorem 14 The observational process will eventually terminate according to the stopping rule with prob- 
ability 1. Moreover, the following statements (I)-(III) hold true: 

(I) Yv{Reject Mi | m} < «i+i + Pi for < i < m — 1 and m G Qi- 

(II) For j = 1, • ■ ■ , to — 1, Pr{ Accept with some index i no less than j | m} * 5 no greater than otj 
and is non- decreasing with respect to fi <E @ no greater than jj,^. 

(III) For j = 1, • • • , to — 1, Pr{Accept J^l with some index i less than j | m} is no greater than f3j and 
is non-increasing with respect to fi € no less than /j,". 

See Appendix [j] for a proof. 

For testing multiple simple hypotheses defined by (j4]) and ((U with 6, 9i identified as m, M» respectively, 
we propose a CSPRT with stopping and decision rules as follows: 



Continue observing (-X"t)te[o,oo) until there exists an index j in the set {0, 1, ■ • • , m — 1} such that 
X t > il^zl+Ml + —£l — l n -L for < i < j and X t < + si — hi & f or j < { < m . 

At the termination of the observational procedure, accept M'j with the index j satisfying 
the stopping condition. 



Same results as in Theorem [T"3l hold for above CSPRT. 



6 Conclusion 

In this paper, we have established consecutive sequential probability ratio tests for testing multiple statis- 
tical hypotheses. Our tests are derived based on the principle of probabilistic comparison. Simple analytic 
formulae are derived for controlling the risk of making wrong decisions. We have demonstrated that the 
new tests can be applied to a wide variety of statistical hypotheses. 



A Proof of Theorem [T] 

By the assumption that U™q 1 {£ = a,, U = b i+1 } 
bj+i} = £1. Therefore, for 6 £ Oi, we have 

{C > 6} = |J {t = e, C > 9} = 
{U<6}= (J {t = e, U < 9} = 



= ft, we have U^iC = a,-} = ft and U^L" 1 ^ = 

[J {t = £, C > a i+1 } = {C> a l+1 }, 
eei-r 

(J {t = i, U < h} = {U< bi}. 
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For i = m — 1, we have Oi = m —i = [bm-ijOo), = L^. m = — oo, aj+i = a m = oo and hence, 

Pi{C > 9} = Pi{C > a i+ i} = = Pr{Lf ii+ i > a i+ i for some £ £ I T } = 0. As a consequence of the 
assumption that U™^ 1 }^ = dj, W = o; + i} = f^, we have 

{t=£,C= aj} = {C = aj } n {t = £} = {€ = a,} n (U^t = I, C = en, U = b l+1 }) 
— { T = £■> C = aj, U = bj + i} 

for j = 0, 1, ■ ■ ■ , to — 1. Hence, for i = 0, 1, • ■ ■ , to — 2 and 6 1 £ (9^, we have 

{£ > 0} = {£ > a m } = (J {r = £ > a l+1 } = |J |J{r = C = a,} 

= U Ui T = e > C = a,,U = b J+1 } 

eeu j>i 

- U S ^ L ^ i + 1 - a »+i} = i L e,i+i ^ a i+i for somc ^ e ^-ri- 
ce U 

For i = 0, we have (9^ = 6*o = (— oo, oi], C/g., = C/g 5 o = °°i bi = bo = — oo and hence, PrjlY < 0} = 
PrjlY < o;} = = Pr{[/f.i < bi for some £ € I T } = 0. As a consequence of the assumption that 

{r = I, U = b J+l } = {U = b j+1 } n {r = £} 

= {U = b j+1 } n (U^o^r = I, C = a,, U = b l+1 }) = {t = L C = a,, U = b j+1 } 
for j = 0, 1, ■ ■ ■ , m — 1. Hence, for i = 1, • • ■ , to — 1 and £ 6*i, we have 

{U<9} = {U<b i }= \J{t = £,U< bi} = |J |J{r = W = 

= U IJ{ T = £ > C = aj ,U = b j+1 } 

C (J (J{L f , fe > a fc , < fc < j and E/^ fc < b k , j < k < to} 

Q |J < bi} = < bi for some £ e I r ). 
eei-r 

This completes the proof of the theorem. 



B Proof of Theorem [2] 

We need a preliminary result stated as follows. 

Lemma 1 Let a £ (0, 1) and Zef 9' , 0" &e two parameter values in O. Then, 

Pr |x„(Af n ; 0', 6>") > - /or some n £ AT | 0'j < a. 

Actually, the result of Lemma [T] is due to Ville [TT] , which was rediscovered by Wald jT2] page 146] . 
We are now in a position to prove the theorem. By the definition of the lower confidence limit, we 
have {L n (X n ) < 9 } 2 {T n (X n ;9 1 ,9 ) > §}. This implies that {L n {X n ) > 9 } C {T n {X n ;9 1 ,9 ) < f } 
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and consequently, Pi{L n (X n ) > 8 for some n £ M \ 8} < Pr { Y n (AT„; 8\, 8) < | for some n E AT \ 8} for 
G 0. It follows from Lemma [I] that Pr{L n (X n ) > 8 for some n £ Af \ 8} < f for 8 £ 0. 

Similarly, it follows from the definition of the upper confidence limit that {T n (X n ; 9o, 9i) > §} C 
{U n (X n ) > 6»i}. This implies that {U n (X n ) < 6»i} C {T n (X n : 8 , 8 X ) < f } and consequently, Pr{U n (X n ) < 
8 for some n £ Af \ 8} < Pv{T n (X n ;8 o ,0) < § for some n £ Af \ 8} for 6 £ 0. It follows from LemmaE 
that Pr{U n (X n ) < 8 for some n £ Af \ 8} < | for 8 £ 0. So, by virtue of Bonferroni's inequality, we have 
Pr{L n (X n ) < 8 < U n (X n ) for all n £ Af | 8} > 1 - 5. This completes the proof of statements (I) and (II). 

By the assumption that f n (X n ;8) is unimodal with respect to 8 £ 0, there exists an estimator 8 n of 
8 such that /«(*¥„; 0) is non-decreasing with respect to 8 £ no greater than 8 n and is non- increasing 
with respect to 8 £ no less than 8 n . Such estimator is referred to as a unimodal-likclihood estimator 
(ULE) of 8. To show statement (III), note that as a consequence of the existence of a ULE 8 n for 8, it 
must be true that {8 n < 8 } C {T n (X n ; 8\, 8 ) > 1} and consequently, {T n (X n ; 8%, 8q) < |, 8 n < 8 } C 
{T n {X n ;8i,8 ) < 1, 0„ < 8 } = 0. It follows that 

r n (X n ;9i,e ) < 1} = 0i, O ) < |, 0« > 6» j C |x n (Af„; 6»i ; 6») < & - for all <9 < 6> J C {L n {X n ) > 9 }. 

Similarly, note that as a consequence of the assumption that there exists a ULE 8 n for 8, it must be true that 
{\> Oi} Q {T n (* n ;0 o A) > 1} and consequently, {T n (Af n ;0 o ,0i) < |, 0n > ^i} C {T„(AT n ; , X ) < 
1, 0« > #1 } = 0- It follows that 

T n (X n ;9 ,9i) < |} = {?„(*„; 0o,6>i) < |, ?« < 0i} C ^T n (X n ;0 o ,9) < i for all 9 > 6>ij C {£/„(*„) < 

This completes the proof of the theorem. 

C Proof of Theorem [3] 

We need to develop some preliminary results based on the assumptions of the theorem. 
Lemma 2 Let a £ (0, 1) and let 8' < 8" be two parameter values in 0. Then, 

h n (x nl 8\8'')>^ch n (x n -e,e'')>^ for 8 g (-00, 8'} n 0. (13) 

Similarly, 

{T n (X n ; 8', 8") < a} C {T n (X n ;8' , 8) < a} for 8 £ [8", oo) n 0. (14) 

Proof. As pointed out in the proof of Theorem [2] in Appendix [B] by the assumption that f n {X n ;Q) is 
unimodal with respect to 8 £ 0, there exists a ULE 0„ for 8. 

To show (IS]), note that {T n (X n ; 8', 8") > ±, 0„ < 6"} = and that {T„(Af„; 6", <9") > i n > 8'} C 
{T„(Af„;0,0") > i} for e (-oo, 0']n0. It follows that {T„(AT„; 9', 9") > ±} = {T„(Af n ;0',V) > i n > 
8'} C {T„(*„;0,0") > i} for 6» G (-oo, 0'] H 0. 

To show (HI]), note that {T n (A? n ; 0', 0") <a,8 n > 8"} = and that {T n (X n ; 8', 8") < a, 8 n < 8"} C 
{T n (X n ;8',8) < a} for 6» G [8", oo) n 0. It follows that {T n (X n ;9' ,9") < a} = {T„(Ar n ; 6»', 5") 
6»"} C {T n (Ar n ;6>',6l) < a} for 8 £ [8", oo) n 0. 

□ 

Lemma 3 {J^? with some I > j is accepted} C {T n (Af„; 0, d'j +1 ) > ^-L- /or some n G A/"} /or < j < 
m — 2 and 8 £ (-oo, d' j+1 ] n 0. 
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Proof. By (|13|) of Lemma [5] and the definition of the stopping and decision rules, 

{M't with some £ > j is accepted} C (J j T n (A'„; ^, 0") > — , 1 < i < £ for some n E A! 



£>j 



C (T„(Af„; 6' j+l ,6'! +1 ) > — for some n £ A/") 



C \ T n (X n ; 9, e'L x ) > for some n eN 



a ]+1 



for < j < m - 2 and (9 e (-co, 6>'- +1 ] n 6. 



□ 



Lemma 4 with some £ < j is accepted} C {T n (X n ; 9'. , 9) < f3j ft 



or some n 



E Af} for 1 < j < m - 1 



and9E [^',oo)n6. 

Proof. By (| 14|) of Lemma [2] and the definition of the stopping and decision rules, 

{J% with some £ < j is accepted} C {T n (X n ; 9\, 9") < ft, £ < i < m for some n E Af} 

e<j 

C {T„(Af„; 0j, 0V) < ft for some n e Af} 
C {T„(Af n ; 6^-, 0) < ft for some n £ TV} 

for 1 < j < m - 1 and 9 E [$'!, oo) n 9. 



□ 



Lemma 5 Let < j < m and 9 E (9'J, oo) n 9. TTien, Pr ^T n (X n ;9' l7 9'/) > for Q < i < j \ 9^ 
the sample number n tends to N* . 

Proof. Let f3 G (0, 1). By (H} of LemmaHJ for < j < m and 9 6 (0", oo) n 9, 



Pr < There exists some i such that < i < j and that T n (X n ; 0;, 0; ) < — I 6 



1 as 



<Y j vAT n {X n -9' ll 9'l)<- \e\ 

i— 1 v ' 



^E 

j 

^E 

?:=i 



Pr^<T„(Af„;^,0 < - 



Vvlp < T n {X n -9' l ,9'l) < 



Yv{T n {X n -9l9'l)<fi\9} 
Pr{T n (AT n ;0 ? ',0)</3|0} 



< 



E 



i 



Pr<M<T n (* n ;0^')< — \B\+(3 



3(3 



as the sample number n tends to N* . But this holds for arbitrarily small (3 E (0, 1). 



□ 



Lemma 6 Let < j < m and 9 E (-co, 0J) n 9. Then, Pr {T n (X n ; 0£, 0") < ft for j < i < m \ 9} -> 1 as 
i/ie sample number n tends to N* . 
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Proof. Let a £ (0, 1). By flT3J| of Lenunai for < j < m and 9 g (-co, 9'j) n 6, 

Pr {There exists some i such that j < i < m and that T„(AT n ; 0") > fa \ 9} 

m— 1 

< ^Pr{T rl (A-„;^,C)>ftin 



m—1 r 

^ E 

m— 1 

< 



Pr ^ pi < T n (X n ; e'l) < - I 6>1 + Pr f T n (AT n ; 9^,9'/) > - 

a a 



< 



E 

m— 1 

E 

i=3 



Pr { A < T„(Af„; , ') < - | 9 \ + Pr ^ T n (X n ; 0, ') > - 

a a 



(m-j)a 



as the sample number n tends to iV*. But this holds for arbitrarily small q€ (0,1). □ 
We are now in a position to prove the theorem. 

C.l Proof of Statements (I)-(III) 

We shall show statements (I)— (III) based on the assumption that the likelihood function f n (X n ;9) is 
unimodal with respect to 8 £ and that the sampling process will eventually terminate according to the 
stopping rule. 

Statement (I) can be shown as follows. Invoking Lemmas CD and 02 we have 

Pr{^ with some i > j is accepted | 9} < Pr |x„(Af„; 9, 9'-) > — for some n £ N \ j < aij (15) 

for j = 1, ■ ■ ■ , m — 1 and 9 £ (-co, 9'j) H 0. Making use of Lemmas [T] and Ofl we have 

Pi{J% with some i < j is accepted | 0} < Pr{T n (Af„; 9'j, 9) < /3 m _i for some n g TV | 9} < /3 m _i (16) 

for j = 1, ■ ■ • , m — 1 and € (0", oo) n 0. Therefore, 

Pr{Rcject \ 8} = Pt{J% with some i > 1 is accepted | 0} < ai for g (-oo, 0^) n 6, 
PrjReject 3tf m -\ \ 9} = Pr{J^ with some i < m — 1 is accepted | 9} < P m -i for g (^m-i> 00 ) ^ ® 

and 

Pr{Reject J£j | 9} = Pt{J%1 with some i > j is accepted | 6*} + Pr{J^ with some i < j is accepted | 9} 
< a j+ i + Pj 

for < j < m - 2 and g (0V, 9' j+1 ) n 6. This proves statement (I). 

To show statement (II), let n denote the sample number at the termination of the sampling process. 
Since the likelihood function f n (X n \ 9) is unimodal with respect to 9 £ 0, we have that for every value n in 
the support of n, there exists an estimator 0„, defined in terms of X n , such that f n (X n ; 9) is nondecreasing 
with respect to 9 £ no greater than 9 n and is non-increasing with respect to 9 £ no less than 9 n . 
Define a sequential estimator 9 by replacing n with n, that is 9 = 9 n . Then, 9 is a ULE of 9. By the 
definition of the stopping and decision rules, we have, for j = 1, ■ ■ ■ , m — 1 and every n in the support of 
n, 

{Accept Mi with some index i no less than j} n {n = n} C |x n (^ n ; 0j,0") > — , n = n j- C |# > 0^, n = n| . 
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It follows that {Accept M'i with sonic index % no less than j} C |# > (9^ j for j = 1, • • • , m — 1. 

According to the second statement of Lemma 3 of [3J version 32, Appendix A3, page 127], we have that 
Pr{ Accept Jf?i with some index i no less than j | 9} is non-decreasing with respect to 9 £ 8 no greater 
than 6'j for j = 1, • • • , m — 1. This result together with the proven inequality (fT5j) complete the proof 
of Statement (II). Similarly, to show statement (III), note that, for j = 1, • • • ,m — 1 and every n in the 
support of n, 

{Accept Ml with some index i less than j} n {n = n} C {T n (A" n ; (9^, < /3j, n = 71} C |# < n = rt j . 

According to the first statement of Lemma 3 of [U version 32, Appendix A3, page 127], we have that 
Pr{Accept J4?i with some index i less than j | 9} is non-increasing with respect to 9 £ G no less than 6" 
for j = 1, • • ■ , m — 1. This result together with the proven inequality (| 16[) complete the proof of Statement 
(III). 

C.2 Proof of the Termination Property 

We shall show that the sampling process will eventually terminate according to the stopping rule under 
the assumption that the likelihood function f n (X n ;9) is unimodal with respect to 9 £ 9 and that ([3]) is 
satisfied. Note that for all n and 9 £ (— oo, 9[) n 8, 

Pr{The sampling process will eventually terminate according to the stopping rule | 9} 

> Pr {T n (X n ; e^e'l) < /3 t for < i < m \ 9} 

It follows from Lemma[6]that Pr { Y„(Af„; 9' i: 9'() < fii for < i < m | 9} — > 1 as the sample number n tends 
to A^*. It must be true that 

Pr{Thc sampling process will eventually terminate according to the stopping rule | 6} = 1 

for 9 £ (-oo,6>i)n6. 

Note that for all n and 9 £ (9[ / n _ 1 ,oo) n 6, 

Pr{The sampling process will eventually terminate according to the stopping rule | 9} 

> Pr f T„(Af n ; O'l) > — for < i < m \ 

It follows from Lemma [5] that Pr |Y n (Af„; 9[, 9'!) > ^- for 0<i<m|6'|^las the sample number n 
tends to N* . It must be true that 

Pr{Thc sampling process will eventually terminate according to the stopping rule | 9} = 1 

for 9 £ (9'^ l _ 1 ,oo) n 8. By Lemmas El [6] and Bonferroni's inequality, we have 

Pr (r n (X n ; > i-, < i < j and T n (X n ; < ft, j < i < m \ o\ -> 1 



for j — 1, • ■ • , m — 2 and 9 £ (9'j , 9j +1 ) n 8, as the sample number n tends to N* . Note that for all n, 



j = !,-■■ ,m-2 and 9 £ (9'L 9') n 8, 



Pr{The sampling process will eventually terminate according to the stopping rule | 9} 

> Pr{T„(Af n ;^,^') > — , < i < j and T n (X n ; 6 1 !) <fc,j<i<m\ 
a,. 



19 



Thus, it must be true that 

Pr{Thc sampling process will eventually terminate according to the stopping rule | 9} = 1 

for j = 1, • • • , m - 2 and G (9], 9' j+1 ) n 9. 

It remains to show that the sampling process will eventually terminate according to the stopping rule for 
9 G [0^,0V]ne with j = I,- - ,m-l. By Lcmma[3 for Kj< m and all 6 G [0$,0V]n0 C (0?_ 1)O o)ne, 

Pr |T n (AT n ; 0j, fl?) > -j- for < i < j | flj -)■ 1 (17) 

as the sample number n tends to N* . By Lcmma[BJ for < j < m— 1 and 9 G [0j-,0"]nOC (— oo, ^ +1 )n6, 

Pr {T n (Af n ; 9[, 9'() < ft for j < i < m | 0} -> 1 (18) 
as the sample number n tends to AT*. By the assumption associated with ([3]), for j = 1, • • • , m — 1 and 

0g [^,S|]n6, 

Pr {r n (Af„; ^, ^) > i- or T„(* n ; 0j, 0$') < ft | j ->. 1 (19) 
as the sample number n tends to N* . Note that 



{The sampling process will eventually terminate according to the stopping rule} 
D Cr n (X n ; 9' i; 9'1) > i- for < i < j and T n (X n ; 9'„ 9'[) < ft for j < i < m J 

U |T n (AT n ; B'^e'l) > ^ for < i < j and T n (X n ; 9' if 6 1 !) < ft for j < i < m j 

= { r n (x n ; e't, e'D > — for o < * < A f| {r n (x n - e' i: e'l) < ft for j < i < m } 



f| |T n (AT n ; 0j, 0?) > i- or T„(Af„; 0$, < ft | 

for j = 2, • • • , m — 2. Making use of this observation, (fT7|) . (|T8|) . (fl9]) and Bonferroni's inequality, we have 
Pr{The sampling process will eventually terminate according to the stopping rule | 6} 
> Pr jT n (Ar n ;0-,0-') > i for < i < j \ 6»| + Pr {T„(Af„; 6»-, 6") < fa for i < i < m \ 9} 

+Pr\r n (x n ;e' j ,e'') > — or T n {x n -e' 3 ,e'^) < fa \ 



for 9 G [9j , 0"] n G with j = 2, • • • , m — 2, as the sample number n tends to iV* . By Bonferroni's inequality, 
we have 

Pr{The sampling process will eventually terminate according to the stopping rule | 8} 

> Pr jx n X) > ^- or T n (X„; 0[, 9") < fa \ 6 J + Pr {T n (X n ; 9'1 ) < fa, 1< % < m \ 6} - 2 

->■ 1 

for G [0'j, 0'/] fl 9, as the sample number n tends to N* . Again by Bonferroni's inequality, we have 
Pr{The sampling process will eventually terminate according to the stopping rule | 9} 
> Pr < T n (X n ; d'm-i) > or T n (X n ; 6' m _ 1 , #m_i) < fan-i \ 9 \ 

{ Ctm-l J 

+ Prlr n (X n ;6' l ,8") > — , < i < m- 1 
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for 9 € [^m-i'^m-i] ^ ®' as the sample number n tends to N* . Therefore, we have shown that, with 
probability 1, the sampling process will eventually terminate according to the stopping rule for 9 £ [ffpff!] 
for j = 1, ■ ■ ■ ,7n—l. This completes the proof of the theorem. 

D Proof of Theorem [4] 

We need some preliminary results. 
Lemma 7 For < j < m — 1, 

{J%£ with some £ > j is accepted} C j T„(Af„; 6j, 0-j+i) > for some n G Af\ (20) 

577717/(7,7%, 

{ tot£/i some £ < j is accepted} C {T n (X n ; 6j—\, 9j) < /3? for some n £ Af} (21) 
for 1 < j < m. 

Proof. By the definition of the stopping and decision rules, 

{J#e with some £ > j is accepted} C j T n (A* n ; 9 i _ ll 9 i ) > — , 1 < i < I for some n e Af\ 

C I T n (AT n ; 9j,6j + i) > for some n e Af 

{ OCj+l 

for < j < m — 1. Similarly, by the definition of the stopping and decision rules, 

{J£? with some I < j is accepted} C {T„(Af„; 0t_i, 0») < ft, £ < 7 < to — 1 for some 77 e A/"} 

C { T„ ( Af „ ; Oj-t , 9j) < f3 j for some 77 e Af} 



for 1 < j < to. 



□ 



We are now in a position to prove the theorem. It follows from (|20|) of Lemma [7] that 
PrjReject Jt?o \ 9o} = Pr{J% with some £ > is accepted | 6*0} 

< Pr jr n (AT„;(9 ,<9i) > for some n e Af \ 6> j < ai. 

It follows from ([2~T]) of Lemma [7] that 

PrjReject J^ m -i | $m-i} = Pr{^5 with some £ < to — 1 is accepted | 6* m _i} 

< Pr {T n (X n ;6 m -2,6 m -i) < P m -i for some n e Af \ 6> m -i} < P m -i- 

It follows from (J20J) and (|2T]) of Lemma [Jj that 

Pr{Reject ^ | <9j} 

= Pr{,i^ with some £ > j is accepted | 6j} + Pr{,i^ with some £ < j is accepted | 8j} 
< Pr j T n (Af n ; flj, fy+i) > — — for some n € Af \ 6j \ + Pr {T„(A?„; ^-i, #.,•) < ft for some n G TV | 0j} 
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Q j + 1 

< + l + ft 



for 1 < j < m — 2. 

To show that the sampling process will eventually terminate according to the stopping rule with proba- 
bility 1, it suffices to apply the argument of the proof of the termination property of Thcorcm[3]in Appendix 
Oto the following hypotheses 

H o :0<$i, H 1 :$ 1 <9<$ 2 , U m _ 2 ;§ m _ 2 <6<ti m _ l , U m .y : 6 > tf m _j 

with di = *~2 + * , i = 1, • • • , in — 1 and indifference zone U™^ 1 (0i_i, 9i). This concludes the proof of the 
theorem. 



E Proof of Theorem [6] 

For simplicity of notations, define Y = In jh^ry ■ Let fi and v denote, respectively, the mean and variance 

of Y associated with 9 e 9. Let Yi,Y 2 , ■ ■ ■ be i.i.d. samples of Y , Define Z n = ^' = ^^ ^ for n = 1, 2, ■ • • . 
By the central limit theorem, Z n converges in distribution to a Gaussian random variable, Z, with zero 
mean and unit variance. Note that 

PrLl3<±Y t <ln 1 -\e)=Fr{^i^<Z n < l ^^\e), n=l,2,.- 

for 9 e 6. 

In the case of fi > 0, we have 

Prjln/3 < jy, < lni | flj < Pr jz„ < | ^ 

for 6* € 9 as n — > oo. To show this, let e > 0. Let z be a number such that Pr{Z < z} < |. Let n be 
chosen such that 2 > ~^=^~ and that | Pr{Z n < z} — Pr{Z < z}| < |. By the triangle inequality, 

Pr (z„ < ln " ~ | 6*1 < Pr{Z„ < z \ 9} < Pr{Z < z] + | Pr{Z„ < z} - Pr{Z < z}\ < e. 



inv 

In the case of u = 0, we have 

{n ^ ( ] R In — 

ln < V < ln - | (9 } = Pr i < Z n < 

for 9 E as n — > oo. 

In the case of < 0, we have 



Pr{M<f:^<]ni|4<Pr(yn>^^ 



0^ ->0 



for e 6 as n — > oo. 

This completes the proof of the theorem. 



F Proof of Theorem [7] 

As in the proof of Theorem \6\ in Appendix [El for simplicity of notations, define Y = ln ^p^.g/) ■ Let /i 
and v denote, respectively, the mean and variance of Y associated with 9 € 6. By the assumption of the 
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theorem, we have /i > and < v < oo. Let Y\, Y%, • ■ ■ be i.i.d. sample of Y. Note that 

1 



Pr{T n (X n -e',e") < 

a 



pJSIUm-M) M, 
n 2 1 



2 In — 

for n > — . By Chcbyshcv's inequality, 



T n (X n ;6',e") <^\9 



EILi(^-m) 



> £ 0> < — ™ ->o 



2 n/i 2 



asn-> 00. This establishes statement (I). In a similar manner, we can show statement (II). This completes 
the proof of the theorem. 

G Proof of Theorem [8] 

For simplicity of notations, dehne Y = T(X). We need some preliminary results. 

Lemma 8 The derivative o/exp (u(6)z — v(9j) with respect to 9 is equal to (z — 0) exp (u(8)z — v(6)) du Jg ■ 
Proof. Since dv ^P = 6 du Jg for 9 6 0, by the chain rule of differentiation, we have that the derivative of 



exp (u(9)z — v(9)) with respect to 9 is equal to (z — 9) exp (u(9)z — v(9)) du jp 



do 

□ 



Lemma 9 The expectation of Y is equal to 9. 

Proof. Let ip(.) be the inverse function of u(.) such that u(ip(0) — C f° r C G { u (@) '■ @ G ©}■ Dchne 
compound function w(.) such that to(C) = v(ip(Q) for £ S {u(0) : £ O}. For simplicity of notations, we 
abbreviate as ?/> when this can be done without causing confusion. Putting £ = u(9), we have 

E [exp(tY)] = E [exp (tT(X))] = J h(x) exp ((£ + t)T{x) - w(Q) dx 

= exp (w(C + t)- w(Q) / h(x) exp ((( + t)T(x) - w(( + t)) dx = exp {w(( +t)- w(()) . 



By the defining relationship u(ip(()) = Cj the assumption that dv }P = 9 du ^P , and the chain rule of 
differentiation, we have 

dw(() dv(ip) dip du(ip) dip du(tp) d( 

~v j / -J7 = i > i? =y-T7 = y(0- (22) 



dC dip d( ^ dip d( r d( T dC 



By virtue of (|22|) . the derivative of w(£ + t) — w(() with respect to t is given by - ' — i/j(( + 1), which is 
equal to "0(C) = 9 for t = 0. Thus, K[Y] = 9, which implies that the sample mean of Y is also an unbiased 
estimator of 9. 

□ 

Lemma 10 The variance ofY is equal to -j^gy- 
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Hence, 



Proof. Now we are in a position to compute the variance of Y. Recall that 

dE[CX jf F)] = ^| exp KC + t) - .(C)) = *(C + t) exp KC + t) - .(C)) . 

rf2E[c ;;f y)] = vac + *) exp (u ,(c + *) - -(0) + exp Mc + t) _ w(c)) 

= </> 2 (C + t) exp (w(( + 1) - w(0) + d ^+^ exp (w(( + 1) - w(Q) ■ 

Therefore, E[Y 2 ] = V' 2 (C) + ^sjp- To compute d ^}P , we differentiate both sides of the defining relationship 
with respect to C to obtain = 1, which implies that = i = -^tW' w here we have used 9 = V'(C) 

to obtain the last equality. Therefore, E[Y 2 ] = ip 2 (C) + A) = # 2 + -atrevj which implies that 

d0 d8 

var[y] = e[y 2 ] - E 2 [r] = e 2 + ^ - 9 2 = 

d0 dS 

□ 

We are now in a position to prove the theorem. Since du }f! > for 6 £ 0, from Lemma [51 we have 
that the derivative of exp (u(9)z — v(9)) with respect to 9 is positive for < z and negative for 9 > z. This 
implies that exp (u{9)z — v{9)) is monotonically increasing with respect to 9 less than z and monotonically 
decreasing with respect to 9 greater than z. Since f„(X n ; 8) = |^exp (u(6) ^ i = 1 ^ < - Xi ^ _ w(0)jj Yl7=i ^ 
follows that f n (X n ;0) is unimodal with respect to € 8. 

Let Xi,X 2 , • • • be i.i.d. samples of X. For parameter values 9', 9" £ O with 9' < 9", the likelihood 
ratio is 

T (x « w cxpM0")?:LinXi)-nv(6")} 

Note that for n = 1, 2, • ■ • , 



a J u(0")-u{9') ^ v ' u(0")-u{0') 



where 



= Pr{np - a < XI T ( X «) < n /° + 5 1 
i=l 

p \ n{p-9)-a njp - 9) + b 



^ _ v(0") - «(0') „_ ln/3 t _ hii 



and 



u(9")-u{9'Y u{6")-u{6')' u{9")-u(9') 

Y n . T(Xi) - n9 

7. — ^» = 1 i 1 77 — 1 2 • • • 

with a 2 = d ^ m being the variance of T(X). From Lemmas 1^1 and ITUl we know that T(X) is a random 

variable with mean 9 and variance a 2 . By the central limit theorem, Z n converges to a Gaussian random 
variable with zero mean and unit variance as n tends to infinity. Consequently, 

P Jn(p-9)-a <Zn< n( P -e ) + b ^ o 



as n — > 00, which can be readily shown by considering the cases of 9 > p, 9 = p and 9 < p as in the proof 
of Theorem [5] in Appendix [E] This completes the proof of the theorem. 
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H Proof of Theorem [9] 



We need a preliminary result. 

Lemma 11 Suppose that (X„)„ e N is a discrete-time process parameterized by 9 G such that for any n, 
the conditional probability density or mass function of X\, • • • , X n -i given the value of X n does not depend 
on 9. Let {^ n } be a natural filtration such that for n € N, where & n is a -algebra generated by X\ , • • • , X n . 

( f (X # ) 1 

Then, for any parameter values 9 and 9\, \ T , v n '' > is a martingale process with respect to the 
filtration {^n} o-nd the probability measure associated with 9q- 



Proof. For simplicity of notations, let x„ = (x±, ■ ■ ■ ,x n ) for n = 1,2, • • • . First, consider the case that 
the PDF exists. By the assumption of the lemma, we have = y*"(*".'g°j or equivalently, 



/*„(x„;(9i) _ fx n (x„;0 1 ) 



(23) 



Let dx„ = dx\ ■ ■ ■ dx n for n = 1, 2, ■ • • . Let Pg denotes the probability measure associated with 9q G 6. It 



(x„+i;6>o) dx n+ i 



follows from J23J that for arbitrary SCR", 



fx n+1 (X n+ i;0i) ^ 
x n <=s fx n+1 (X n+ i,9 ) 



fx n+1 {xn+i;0i) 
c " e f B fx n+ i{x n+ i;9 ) 

/.Y„ + i(Xrt+i; 9i) 
fx n + Mn+l\9 ) JXn + 

j /.¥„ + i ( x n+l! 9\) dx n+ i 



fx„ +1 (x-n+i]9 ) d 



x„es 



fx n+1 (*n+l] #1 ) dx n+ \ 



x„es 



/at„(x„;6'i) dx n = 



dx n 



f Xn {yj n ;9i) 
is /-v„( x ™;0o) 



fx n (x n ;9i) 
s fx n {x n ;9 ) 



fx„(Xn]9 ) dXr, 



fx n (x n ;9 ) dx„ 

fXn (X n ]8l) na_ 



x n £S fx n (X n ;9 ) 



which implies that | /"(x"'flo) ' ^ s a mar tingalc with respect to the filtration {^ n } an d the proba- 

bility measure associated with 9q. In the case that the PMF exists, the integration in the above is replaced 
by summation. 



□ 



We are now in a position to prove the theorem. Dehne Y t = T t (X t ; 9q, 9\) for t G [0, oo). Define 



Qk = {0} U 11 : gcd(p,g) = 1; p,q G N; p < k 
IP 

for k — 1, 2, ■ • • , where gcd(p, q) denotes the greatest common divider of p and q. Let Q denote the set of 
non-negative rational numbers. Define Ej = {u G : sup t£ Q. Y t (ui) > j}. Then, 

Qj Q Qj+i => sup Y t (ui) < sup Y t (cj) Ej C E j+1 . 
teQ, teQj+i 

Define E^ = |w G 51 : sup j6 gYj(w) > ||. It is easy to show that Eoo = \Jj^ E,j. As a consequence of 
the continuity of the probability measure, Pr{£' 00 } = lim„_ i . 00 Pr{E„}. By Lemma [TT1 {Y t , t G Qj} is 
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a martingale process. It follows from Doob's super-martingale inequality that Pi{Ej} < 5 E[Yo]. This 
implies that Prji^oo} = Urn,-^ Pr{Ej} < 8 E[Y" ]- We claim that sup tg g lt(w) = sup te ^ Q oo ^Y t (uj). To 
show this claim, note that for any t <E [0, oo), there exists a sequence {Qj^jLi n o less than t such that 
Yt(w) = linij^oo Y qj (ui). That is, the sample path of Yt is right-continuous. Observing that Y q .(ui) < 
sup tg g Yt(ui), we have Y t (uj) < sup tg g Y t (co), which implies that sup tg [ ^ Y t (uj) = sup tg g Y t (uj) and thus 
the claim is established. This proves (fTT|). that is, Pr{ Y t > i for some t £ [0, oo) | 6q} < 5. 

By the definition of the lower confidence limit, we have {Lt(Xt) < 0o} 3 {Tt(X*; 0i, 0o) > §}• This 
implies that {L t (X t ) > O } C {T t (X t ; U O ) < §} and consequently, Pi{L t (X t ) > for some t \ 0} < 
Pr {T t (X t ; 0i, 0) < | for some t \ 9} for £ 6. It follows from the proven inequality {TTJ that Pr{L t (X f ) > 
0for somei | 0} < f. 

Similarly, from the definition of the upper confidence limit, we have {T t (X t ; 0q, 0i) > §} C {[/((A^) > 
0i}. This implies that {£/ t (A t ) < 0i} C {T t (A f ; O , 0i) < f } and consequently, Pr{[/ t (A" t ) < 9 for some t | 
0} < Pr {T t (X t ; 6> , 0) < f for some i | 0} for e 6. It follows from ((TTJ) that Pr{L/ t (X t ) < for some t \ 
9} < |. So, by virtue of Bonferroni's inequality, we have Pr{L t (X t ) < 9 < U t {X t ) for all t | 0} > 1 - 5. 
This completes the proof of the theorem. 



I Proof of Theorem [12 

We need some preliminary results. 



Lemma 12 For arbitrary a, /3 £ (0, 1) and A, A', A" <G (0, oo) with A' < A", 



lim Pr \p < T n (X n ; A', A") < - | A = 0. 
t-voo I a 



Proof. Note that 



, < T.(*.i V, A") < i | a| = Pr( (V '-^ +ln<i < X, < P'-y-t | A 



A' 



A' 



Therefore, Pr{^ < T„(Af„; A', A") < ± | A} can be written as Pr{pt - a < X t < pt + b | A}, where 



(A"-A') 
In ±r 



tP- and a, 6 arc some positive numbers. Define Y t = X ^^ 1 ■ Then, 

( P -A)f- ^ Yt< (p-Ajt + 6 , 



At 



Noting that 



E 

and that 



exp s 



X t -At 



'At 



= exp(- S A/Xi) E 



exp s 



A', 



= exp < — sV Xt + Xt 



exp 



'Xt 



- 1 



lim { -sVXt + Xt 



exp 



lim < - 

t— yoo L 



-st + r 



exp 



lim ^ -st + t 



s s 2 (\ , 

1 + t + ^ +0 U l 



wc have that Yj = ^' /T At converges to a Gaussian random variable with zero mean and unit variance as 
t — y oo. Consequently, 

Px{pt-a<X t <pt + b\X} = pA {p - X ^- a <Y t < ip ~ X ]l + b \X^0 



Xt 



Xt 
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as t — > oo, which can be readily shown by considering the cases of A < p, A — p and A > p as in the proof 
of Theorem [5] in Appendix [E] 

□ 

Lemma 13 For arbitrary integer n and real numbers U, i = 0, • • • , n with = to < ti < • • • < tn—i < 
= t, the conditional probability mass function of X til i = 0, 1, • • • , n — 1 given the value of X t does not 
depend on A. 

Proof. Note that for a Poisson process (Xt)te [o,oo) with an arrival rate A > 0, we have 

tt™ [(ti-t,-i)A] J: '~ x '-ie~ x(t '~ t '-i ) n 

Pr{X tl = Xj, z_=Jy - ,n} _ 1L=i (xj-xj-i)! x n l yr (U - U-ir' 

Pr{X tn =X„} ~ (t„A)^e-A t „ -( tn )*„ll (Xi-Xi^l ' 

where xq = 0. This implies that the conditional PMF of X ti , i = 1, ■ ■ ■ , n — 1 given the value of Xt n does 
not involve A. 

□ 

We are now in a position to prove the theorem. It can be readily checked that ft(X t ; A) is unimodal 
with respect to A > 0. Applying this fact and Lemma [T2l leads to the conclusion that the observational 
process will eventually terminate with probability 1. As a consequence of the proven termination property 
and Lemma [T31 statements (I) , (II) and (III) of Theorem follow from Theorem [TO] This completes the 
proof of the theorem. 

J Proof of Theorem [14 

We need some preliminary results. 

Lemma 14 For arbitrary ct,f3£ (0, 1) and p, p! , p" £ (—00,00) with p! < p" , 

lim Pr| p <T t (X t ;p, p") <- |/4=0. 

t— >oo a J 

Proof. Note that 

p.{* < t,(x«;,v) < i 1 ,} = vA<Jl±pi + jiLm < x, < ^±pi + ^L. h I 1 ,) . 

L a J ^ 2 p" — p' 2 p" — p' a ) 

Thus, Pr {/3 < T t (A t ; p', p") < £ | p} can be written as Pr{pt - a < X t < pt + b \ p}, where p = 0'+/*") 
and a, 6 are some positive numbers. Define Y" t = A ^^* . Then, is a Gaussian random variable with zero 
mean and unit variance. It follows that 

Pr{ P t-a<X t < P t + b\p} = Pr\ {p -^- a <Y t < ip -^ + b \p\^Q 
as t — > 00, which can be readily shown by considering the cases of p < p, p = p and p > p. 

□ 

Lemma 15 For arbitrary integer n and real numbers ti, i = 0, ■ • • , n with = to < t\ < ■ ■ • < i n _i < 
i„ = t, i/ie conditional probability density function of X ti , i = 0, 1, • • • , n — 1 given tte i>a?we 0/ A t does 
not depend on p. 
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Proof. Define = X ti — X ti _ t for i = 1, ■ ■ ■ , n, where X to = Xo = 0. Then, are independent 
Gaussian variables with PDFs 

tt \ 1 ( fc-fc-fr-i)/*] a> \ ■ - 

;j = — , exp — ; — = — , z = 1, • ■ ■ , n. 

Note that Pr{X ti < a^, i = 1, • • • , n} = / • • • J (zi ... j2n)eS Il"=i efoi • • • efon, where S = {(zi, ■ ■ ■ ,z n ) : 

Z)?=x z ' ^ ^ for j = 1, • • • , n}. Define yj = z i for 3 = 1> • • ' > n - Then, zi = ^ and z,- = - 

for j = 2, - ■ ■ ,n. Note that the determinant of the Jacobian of the transformation is equal to 1 and thus 

h(yi) ■ J fj(Vj - Vj-x) ■ J fn{Vn - Vn-x)dy n ■ • • e% ■ ■ ■ dy x . 

-oo J — oo J — oo 

Sequentially taking partial derivatives of the multiple integral with respect to x n ,x n —i, ■ ■ ■ ,x\ gives 

gn n 

Pr{X u < i = !,••■ ,n} = JJ/i(x» - Xi-i), x = 0. 



dx\dx2 ■ ■ ■ dx n 



It can be checked that 



a|:Pr{X t „ <x„} ^f^exp 



which is independent of fi. 



□ 



We are now in a position to prove the theorem. It can be readily checked that ft(X t ; fi, a) is unimodal 
with respect to fi E (—00,00). This fact together with Lemma [T4l lead to the conclusion that the obser- 
vational process will eventually terminate with probability 1. As a consequence of the proven termination 
property and Lemma [T5l statements (I), (II) and (III) of Theorem [T4l follow from Theorem [TOl This 
completes the proof of the theorem. 
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